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-- The MAILING DATE of this communication appears on the cover sheet with the correspondence address ~ 
Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 . 1 36 (a). In no event, however, may a reply be timely filed after SIX (6) MONTHS from the 
mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and wilt expire SIX (6} MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 

- Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1 .704(b). 

Status 

1 )□ Responsive to communication(s) filed on 



2a) □ This action is FINAL. 2b) (xl This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 11; 453 O.G. 213. 

Disposition of Claims 

4) 1x1 Claim(s) 1-20 is/are pending in the application. 



4a) Of the above, claim(s) 
5)D Claim(s) 



6) 53 Claim (s) 1-20 

7) D Claim(s) 

8) □ Claims 



is/are withdrawn from consideration. 

is/are allowed. 

is/are rejected. 

is/are objected to. 



are subject to restriction and/or election requirement. 



Application Papers 
9) □ The specification is objected to by the Examiner. 

10)D The drawing(s) filed on is/are a) □ accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 
1 !)□ The proposed drawing correction filed on is: a)D approved b)D disapproved by the Examiner, 

If approved, corrected drawings are required in reply to this Office action. 

12) D The oath or declaration is objected to by the Examiner. 
Priority under 35 U.S.C. §§ 119 and 120 

13) D Acknowledgement is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (f). 
a)D All b)D Some* c)D None of : 

1 . □ Certified copies of the priority documents have been received. 

2. □ Certified copies of the priority documents have been received in Application No. . 



3. □ Copies of the certified copies of the priority documents have been received in this National Stage 
application from the International Bureau (PCT Rule 17.2(a)). 
*See the attached detailed Office action for a list of the certified copies not received. 

14) D Acknowledgement is made of a claim for domestic priority under 35 U.S.C. § 1 19(e). 
a)D The translation of the foreign language provisional application has been received. 

15) D Acknowledgement is made of a claim for domestic priority under 35 U.S.C. §§120 and/or 121. 

Attachment(s) 

1) [^Notice of References Cited (PTO-892) 



2) O Notice of Draftsperson's Patent Drawing Review {PTO-948) 

3) ^| Information Disclosure Statement(s) (PTO-14491 Paper No(s). 2 



4) Q Interview Summary (PTO-413) Paper No(s). 

5) Q Notice of Informal Patent Application (PTO-1 52) 

6) □ Other: 
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DETAILED ACTION 

Claim Rejections - 35 USC §102 

1. The following is a quotation of the appropriate paragraphs of 35 U.S. C. 102 that form the 
basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public use 
or on sale in this country, more than one year prior to the date of application for patent in the United States. 

2. Claims 1, 5-7, 15 and 19-20 are rejected under 35 U.S.C. 102(b) as being anticipated by 

Ellozy et al (5,649,060). 

As per claim 1 and 19-20 Ellozy et al teach a method of processing audio-based data 
associated with particular language, the method comprising (figure 3): 

"Storing the audio-based data"( his Audio/Video recording 12, col. 5, lines 5-20); 
"Generating a textual representation of the audio-based data the textual 
representation being in the form of one or more semantic units corresponding to the audio-based 
data"( his Automatic Speech Recognizer 31 and his Decoded Text 38; col. 5, lines 30-35); and 

" indexing the one or more semantic units and storing the one or more indexed semantic 
units for use in searching the stored audio-based data in response to a user query"( his indexing 
60, col.7, lines 13-20). 
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As per claim 5, Ellozy et al teach wherein the generating step comprises decoding the 
audio-based data in accordance with a speech recognition (figure 3, his automatic Speech 
Recognizer 34, col. Col. 5, line 30-32). 

As per claim 6, Ellozy et al teach wherein the speech recognition system employs a 
semantic unit based language model (col. 6, lines 47-65, his word language model ). 

As per claim 7, Ellozy et al teach wherein the indexing step comprises time stamping the 
one or more semantic units"(col. 5, lines 47 to col. 6, line 30, his time stamping of the indexed 
words). 

As per claim 15, Ellozy et teach wherein the one or more semantic units are indexed 
according to at least one of when the audio based was produced and where the audio based data 
was produced ( figure 3, his time alignment 42). 

Claim Rejections - 35 USC §103 

3. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all obviousness 

rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

4. Claims 2-4 are rejected under 35 U.S.C. 103(a) as being unpatentable over Ellozy et al 

(5,649,060j in view of the Background of the invention. 
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It is noted that Ellozy teach a word based audio indexing but does not explicitly teach 
wherein the semantic unit is a syllable, wherein the syllable is a phonetically based syllable" and 
wherein the semantic unit is a morpheme. However, this features are well known in the art as 
evidenced by the Background of the invention which teaches a phone based indexing method and 
also teaches that a morpheme could be a word. Therefore, one having ordinary skill in the art at 
the time the invention was made would have it obvious to recognize that the word based audio 
indexing of Ellozy could be a syllable or a morpheme based audio indexing because it would 
provide a more efficient indexing method. 

5. Claims 10-13 are rejected under 35 U.S.C. 103(a) as being unpatentable over Ellozy et al 
(5,640.0600 in view of Nanjo et al (5,778,361). 

As per claims 1 1-13, it is noted Ellozy teaches the claimed invention but does not 
explicitly teach wherein the particular language is Chinese. However, this feature is well known in 
the art as evidenced by Nanjo et al who teach a system for fast indexing and searching in 
compound word languages such as Chinese at the abstract. Therefore, one of ordinary skill in the 
at the time the invention was made would have found it obvious to recognize the language used in 
Ellozy' s system could be Chinese as taught by Nanjo because Nanjo teaches the benefit of using 
an improved method for indexing and searching Chinese language. 
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6. Claim 8 and 9 are rejected under 35 U.S.C. 103(a) as being unpatentable over Ellozy et 
al (5,649,060) in view of Orsolini et al (5,794,249) 

Is it noted that Ellozy et al teach the automatic indexing and aligning of audio and text 
using speech recognition but does not explicitly teach :wherein the searching step comprises: 

"Processing the user query to generate one or more semantic units representing the 
information that the user seek to retrieve"; "Searching the one or more indexed semantic units to 
find a substantial match with the one or more semantic units associated with the user query"; and 
"Retrieving one or more segments of the audio-based data using the one or more indexed 
semantic units that match the one or more semantic units associated with the user query". 
However these features are well known in the art as evidenced by Orsolini et al who teach the 
searching step comprises: 

"Processing the user query to generate one or more semantic units representing the 
information that the user seek to retrieve"; col. 1, line 65 to col. 2, line 9, the user choose a 
keyword and used to query the text balanced tree for each recording, col. 5, lines 28-43,); 

"Searching the one or more indexed semantic units to find a substantial match with 
the one or more semantic units associated with the user query"; ( col. 2, lines 3-9; col. 5, lines 45- 
55); and 

"Retrieving one or more segments of the audio-based data using the one or more 
indexed semantic units that match the one or more semantic units associated with the user query" 
( col. 2, lines 10-24, col. 5, lines 45-61). 
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Therefore, one having ordinary skill in the art at the time invention was made would have 
found it obvious to incorporate into Ellozy's system a searching system as taught by Orsolini et al 
because it would provide for efficient content searching of recordings. 

As per claim 9, Orsolini et al teach wherein the searching step further comprises 
presenting the retrieved data to the user"( col. 5, lines 45-48). 

7. Claim 13 is rejected under 35 U.S.C. 103(a) as being unpatentable over Ellozy et al 
(5,649,060). 

It is noted that Ellozy et al teach the claimed invention but does not explicitly teach the 
one or more semantic units are indexed according tof speaker attributes. However, this feature is 
well known in the art. Therefore, one having ordinary skill in the art at the time invention was 
made would have found it obvious to recognized that the semantics units in Ellozy's system are 
indexed according to speaker attributes because it would provide an efficient method of 
identifying the corresponding speakers. 

8. Any response to this action should be mailed to: 

Commissioner of Patents and Trademarks 
Washington, D.C. 2023 1 or faxed to: 

(703) 308-9051, (for formal communications intended for entry) Or: 

(703) 305-9508 (for informal or draft communications, please label "PROPOSED" or 



DRAFT") 
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Hand-delivered responses should be brought to Crystal Park 1 1, 2121 Crystal Drive, Arlington. 
VA., Sixth Floor (Receptionist). 

6. Any inquiry concerning this communication or earlier communications from the examiner 
should be directed to Patrick N. Edouard whose telephone number is (703) 308-6725. The 
examiner can normally be reached on Tuesday-Friday from 07:30 a.m.-6:00 p.m. 

If attempts to reach the examiner by telephone are unsuccessful, the examinees supervisor, 
Marsha Banks-Harold, can be reached on (703) 305-4379. 

The facsimile phone number for this Art Unit is (703) 305-9508. Alternatively, facsimile messages 
may be sent directly to (703) 305-9644 where they will be stored in the examinees voice mailbox 
(telling the examiner that a fax was received) and be automatically printed (i.e. - no delay by the 
examiner). 

Any inquiry of a general nature or relating to the status of this application should be 
directed to the Group receptionist whose telephone number is (703) 305-3900. 



Patrick N. Edouard 
June 26, 2003 



